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■ 1 Abstract 

C/^ ' In this paper, we discuss delayed periodic dynamical systems, compare capability of 

^ ! criteria of global exponential stability in terms of various (1 < p < oo) norms. 

■ A general approach to investigate global exponential stability in terms of various 
{I < p < oo) norms is given. Sufficient conditions ensuring global exponential stability 
are given, too. Comparisons of various stability criteria are given. More importantly, 

^ ! it is pointed out that sufficient conditions in terms of norm are enough and easy 

^ ' to implement in practice. 
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X ■ 2 Introduction 

Recurrently connected neural networks, sometimes called Grossberg-Hopfield neural 
networks, have been extensively studied in past years and found many applications in 
different areas. However, many applications heavily depend on the dynamic behaviors 
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of the networks. Therefore, analysis of these dynamic behaviors is a necessary step 
toward practical design of these neural networks. 

A recurrently connected neural network is described by the following differential 
equations: 

'^^!^^ = -diUi{t) + aijgj{uj{t)) + k z = l,---,n (1) 

where gj(x) are activation functions, di, aij are constants and /j are constant inputs. 
In practice, however, the interconnections are generally asynchronous. Therefore, one 
often needs to investigate the following delayed dynamical systems: 

= -diUiit) + ^ijOjiujit)) + Y Kfjiujit - Tij)) + Ii i = l,---,n (2) 

j j 

where activation functions gj and fj satisfy certain defining conditions, and aij, bij, li 
are constants. 

All these neural networks and their corresponding delayed systems have been ex- 
tensively studied, and there are many papers considering their global stability in the 
literature, for example, see P [3l El [71 [HI [El [IS [151 [ISl [111 [I9] and others. 

However, the interconnection weights aij, bij, self- inhibition di and inputs Jj should 
be variable with time, often periodically. Therefore, we need to discuss following 
dynamical systems and their periodic limits. 

dui " 

—1 = -di{t)ui{t) + J2(^ij{'t)9j{uj{t)) + Yhj{t)fj{uj{t-Tij))+Ii{t), i = l,2,...,n 
j=i j=i 

(3) 

where diit) > di > 0, aij(t),bij{t), Ii{t) : R+ R are continuously periodic functions 
with period > 0, i.e., diit + oj) = diit), aijit) = aijit + u), bij{t) = bijit + u), 
liit) = liit + uj) for alH > and i,j = 1,2, ... ,n. 

The initial conditions are 

Uiis) = (piis) for sE f— r, 0], where r= max Tij (4) 

l<i,j<n 
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where 0j G r, 0]),i = 1, ■ ■ ■ ,n. 

We also denote \a*j\ = sup{o<t<^} |aij(t)| < oo, \b*j\ = sup|o<t<^} < oo, 

|/*| = sup|o<t<<^} |/i(t)| < oo, where i,j = 1,- 

There are also several papers discussing periodic dynamical systems and their periodic 
solutions and its stability. For example, see [21 IH El [HI [lOl |171 [HI [20] and others. 

In this paper, our main concerns are comparisons of the capability of various criteria 
in proving the existence of periodic solution and its stability. For this purpose, we first 
discuss the existence of periodic solution and its stability in terms of (1 < p < oo) 
norms. We do not assume that the activation functions are bounded. We also do not 
use existing complicated theory (for example, topological degree theory, fixed point 
theorem and so on), as needed in most other papers, to prove the existence of periodic 
solution. Instead, we propose a general and very concise approach. By this approach, 
we prove exponential convergence directly. The existence of the periodic solution is a 
direct consequence of the exponential convergence. 

This paper is organized in the following way: In section 3, some preliminaries, including 
several definitions and Young Inequality as lemma, are given. In section 4, we prove 
the global stability in terms of norms. Main comparison results are given in section 
5. In this section we point out that the criteria in terms of norm are enough. We 
conclude the paper in section 6. 

3 Some preliminaries 

Definition 1 Class H{Gi, ■ ■ ■ , Gn} of functions: Let G = diag[Gi, ■ ■ ■ , where 
Gi > 0, i = 1, ■ ■ ■ ,n. g{x) = {gi{x), - ■ ■ , gn{x)Y is said to belong to H{Gi, ■ ■ ■ , Gn}, 
if the functions gi{x), i = 1, ■ ■ ■ , n satisfy ^^'^^"'""^P^'*'^''^ < Gi. 

Definition 2 A vector v = [vi, ■ ■ ■ , Vn]'^ > 0, if and only if every Vi > 0, i = 1, ■ ■ ■ ,n. 
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Definition 3 A real n x n matrix C = (cij) is said to be an M-matrix if Cij < 0, 
i, j — 1, ■ ■ ■ ,n, j ^ i and all successive principal minors of C are positive. 



Definition 4 Throughout this paper, we use the following norm 



\{^,p} 



Ui 



n 7 



where u{-) = [ui{-) , ■ ■ ■ , Un{-)f ■ 

Lemma 1 (Young Inequality) If a > 0, 6 > 0, then 



P 



where e > 0; p, q > 1; ^ + ^ = 1. The equahty holds if and only if 



(aef = {be-') 



(5) 



(6) 



(7) 



Proof Let f{x) = e^. Obviously f"{x) > 0. Thus 



f{ax + (3y)<af{x) + (3f{y) where q;>0,/3>0,q; + /3=1 



that's 



e^^e^y < ae" + /3e'^ 
where equality holds if and only ii x — y. 

Let a = = a; = -lna£, y = ^lnbs~', we obtain 

P Q 

and the equality holds if and only if 



(8) 



(9) 



{aef = {be-y 



(10) 
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4 Main Results 



In this section, we discuss the existence of periodic solution and its stabihty. We 
propose a general and concise approach and give several theorems on the existence of 
periodic solution and its exponential stability. 

Theorem 1 Suppose that 1 < p < oo, g(x) = {gi{x), - ■ ■ , gn{x)Y G H{Gi, ■ ■ ■ , 
and /(x) = ■ ■ ■ , fn{,x)Y G H{Fi, ■ ■ ■ , If there are real constants e > 0, 

C,i > 0, ttij, Pij, i,j = 1,2 ■ ■ ■ ,n, such that 



[-di + e)^i + Gi 



+ -Ee.l^lH + hT.GM^l^'-'^''^' 



-| 71 in 

P j=i 1 j=i 



In particular, aij = Pij = -, 



-di + e)^i + Gi 



p jj^i " j^i 



-in -in 

P i=i i=i 



+ =0(e-^'^"), i = l,---,n 



(11) 



(12) 



Then the dynamical system ([3]) has a unique periodic solution t>(t) = [t>i(t), ■ ■ ■ , f„(t)] 
and, for any solution u{t) = [ui{t), - ■ ■ , Un(t)] of ([3]), 



(13) 



Proof Let Ui{t) = Ui{t + uj) - Ui{t) , gi{ui{t)) = gi{ui{t + uj)) - gi (ui (t) ) , fi (ui (t) ) 
fi{ui{t + uj)) - fi{ui{t)), and Wi{t) = e^^Ui{t), i = 1, 2, ■ ■ ■ , n. 



Defining a Lyapunov function by 

1=1 i,i=l "^'J 



(14) 
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and differentiating it, we have 

n 

Li{t) ^ pJ2Ci\wi{t)\P-'e''sign{wi{t)) 



i=l 



di{t)ui{t) + eui{t) 



i=i i=i 



i=l 



< pJ2^i - {di - e)\wi{t)f + aii{t)e'%{ui{t))\\wi{t) 



IP-i 



n p 

By Young inequality and 



we have 



r r 1 11 

" n 1 1 "I 

< 



Therefore, Li{t) is bounded, which imphes 

n 
i=l 

is bounded and 



\ui{t + u)-Ui{t)\=0{e i = l,---,n 



Now, define a function v{t) = [vi(t), - ■ ■ , Vn(t)]'^ by 

Vi(t) = lim Ui(t + juj) 

Because of 

Ui{t + juj) = Ui{t) + + ~ ^ii^ +{k- 

k=l ^ ^ 

and ( |2T]) . f (t) is well defined and is a periodic function with period uj. Moreover, 
If u{t), v{t) are two solutions. By similar method used before, it is easy to prove 



\ui{t + juj) — Vi(t + juj)\ = 0{e "'^'^) when j —>■ oo 



(22) 



which means the limit solution is unique. Theorem 1 is proved completely. 

Corollary 1 Suppose that 1 < p < oo, g{x) = {gi{x), - ■ ■ , gn{x)Y £ H{Gi, • ■ ■ , G„} 
and /(x) = (/i(a;), ■ ■ ■ , fn{x)Y' € H{Fi, ■ ■ ■ , Fn}. If there are real constants > 0, 
aij, Pij, i,j = 1, 2 ■ ■ ■ , n, such that 



'di^i + Gi 



1 



e.l<l + -EO 



In particular. 



7* |"iiP 



in in 



-j^ n 1 " 

+ -^^Eoi&*j + -e.E^.i&r,i<o 



(23) 



(24) 



Then the dynamical system ([3]) has a unique periodic solution v(t) = [vi(t), - ■ ■ , f„(t)]'^ 
and, there is e > such that for any solution u{t) = [ui(t), - ■ ■ , 'U„(t)]-^ of ([3]), we have 



\ui(t + juj) — Vi(t)\ = 0{e ^^'^) when j ^ oo 



(25) 
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In fact, under the assumptions given in Corollary 1, we can find e such that ([TT 
or ffT2l) is satisfied. 



The case p = 1 is the most interesting. In Theorem 1, let p = 1 and aij = jSij = 1, 
we have following 

Theorem 2 Suppose that 1 < p < oo, g(x) = {gi{x), - ■ ■ , gn{x)Y G H{Gi, ■ ■ ■ , 
and /(x) = (/i(a;), ■ ■ ■ , fn{,x)Y £ H{Fi, ■ ■ ■ , If there are positive constants e, 9i, 
2 = 1, 2 ■ ■ ■ , n, such that 



-di + e)ei + G^ 



^.Kl + E^.I4I + F,T.(^,\h]M'^^^ < (26) 



Then the dynamical system ([3]) has a unique periodic solution v{t) = [vi(t), - ■ ■ , f„(t)]"^ 
and, for any solution u(t) = [ui(t), - ■ ■ , Un(t)]'^ of ([3D, 



\u,it + jiu) - Viit)\ =0(e-^'^"), t = l,---,n 



(27) 



If 



-diOi + Gj 



(2^ 



Then the dynamical system ([3]) has a unique periodic solution v(t) = [t>i(t), ■ ■ ■ , f„(t)]^ 
and, there is e > such that for any solution u{t) = [ui{t), - ■ ■ , Un{t)]^ of ([3]), we have 



\ui{t + jLo) - Vi{t)\ =0(e-^'^"), i = l,---,n 



(29) 



Theorem 1 and Theorem 2 apply to the model ([2]), too. If we consider constants di, 
ttij, bij li as periodic function with any period. Then, the limit v{t) is also a periodic 
function with any period and thus is a constant vector v* = [v^, ■ ■ ■ Therefore, 
we have 

Theorem 3 Suppose that 1 < p < oo, g{x) = {gi{x), - ■ ■ , gn{x))^ G H{Gi, ■ ■ ■ , 
and f{x) = (/i(a;), ■ ■ ■ , fn{x))^ G H{Fi, ■ ■ ■ , F^}. If there are real constants aij, Pij, 
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positive constants e, ^j, 6i, i,j = 1,2 ■■■,n, such that either one set on inequahties 
holds 



[-di + e)^i + Gi 



in -in 

P j=i Q j=i 



(30) 



-di + e)^i + Gi 



P 



in 1 " 



P 



(31) 



-c/i + e)0, + Gi 



ei\aii\+Y. +F^T. e"'' < (32) 

j^i j=i 



Then the dynamical system ([2]) has a unique periodic equilibrium v* = [vl, ■ ■ ■ ,v^]'^ 
and, for any solution u{t) = [ui(t), - ■ ■ , Un(t)]'^ of we have 



\ui{t)-v*\=0{e-''), i = l,---,n 



(33) 



Corollary 2 Suppose that 1 < p < oo, g{x) = {gi{x), - ■ ■ , gn{x)Y G H{Gi, • ■ ■ , G„} 
and /(a;) = (/i(a;), ■ ■ ■ , fn{,x)Y £ H{Fi, ■ ■ ■ , If there are real constants a^, 
positive constants ^j, 6'j, i, j = 1, 2 ■ ■ ■ , n, such that either one set on inequalities holds 



'di^i + Gi 



1 



+ -Ec 



J I "'J* I 



+ -6EG'.I«^.I^'""^-^'' 



in 1 71 

+ -i^.Ee#,/^'^ + -e.E^.l^^.l^'"''^^'^' < 

P J^i Q J^i 



(34) 



~di^i + 



I Am I H — E I I ^ — ^« E ^. 



P 



n 1 

+ -^^EOI&..l + -e.E^.I%l<o 



(35) 
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diOi + Gi 



Oi\aii\ + ^9j\aji\ + Fi^9j\bji\ < 



(36) 



Then the dynamical system ([2]) has a unique periodic equihbrium v* = [vl, ■ ■ ■ ,v^]'^ 
and, there is e > such that for any solution u{t) = [ui(t), - ■ ■ , of ([2]), we have 



\ui{t)-Vi{t)\=0{e-''), « = l,---,n 



(37) 



Remark 1 In [3., 8J, under additional assumptions that all aij{t), bij{t) and di{t) 
are constants and gj{x), fj{x) are bounded functions, it was proved in [3J that under 
( 12^ or in [8] that under (ITTi) . the dynamical system 

dui " " 

= -diUi{t) + ^ aijgj{uj{t)) + ^ bijfj{uj{t - Tij)) + /i(t), i = 1, 2, . . . , n (38) 

j=i j=i 

has a unique periodic solution v(t) = [vi(t) , ■ ■ ■ , Vn(t)]'^ and, any solution u{t) = 
[ui{t), ■ ■ ■ , Un(t)]'^ of fl5S]) converges to v{t). It is easy to see that this is a special case 
of previous Corollary 1. Moreover, in [3j, the author did not address the convergence 
rate. It should also be emphasized that parameters aij, j3ij play key role in the 
Theorem 1 and Corollary 1. The special one (|2^ is not the best criterion. It is 
important to look for the best parameters aij, Pij. We will discuss in next section. 



5 Comparisons 

In previous section and many existing papers, various stability criteria are given. It is 
an important issue to answer the question whether or not they are equivalent. If not, 
which one is better. That is we should compare capability of various stability criteria. 

In this section, we will address this issue by proving several theorems, from which 
we assert that the conditions in terms of norm [ (!26l) (!28l) ( |32l) ( |36l) ] are enough in 
practice. The criteria with norm [ (ITTll (l23ll (l30il (IMl) ] are of no great significance 
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and those, letting aij = 1/p, jSij = 1/p [ (fT2|) fl24|) fl3T|) (135|) ]. are less capable than 
conditions in terms of L^. 

We prove the following result first: 

Theorem 4 Suppose Cj > 0, Gj > 0, Fj > 0, Cij > 0, dij > 0, > 0, z, j = 1, ■ ■ ■ , ra. 
If there exist > 0, aij, Pij, p > 1, q > 1, ^ + ^ = 1 such that the following 
inequalities 

1 



+ - E % ' (^^jFjC. < 0, z = 1, ■ ■ ■ , n (39) 
hold. Then, we can find constants 6i > (i = 1, - ■ ■ n) such that 



- Ci9i + GiJ2(^jCji + Fi^OjdjiCji <0, i = l,---,n (40) 



hold. 



Proof If there exist > 0, aij, (3ij, p> 1, g > 1, ^ + ^ = 1 such that (!39l) hold. 
Denote 

r = + i ^ c^^-'^'^'^'G, + i E ^r^'^'^'e^.F, i = l,---,n 
M = {niij} : < 

Then, (1391) can be rewritten as < 0. By the property of M-matrices, there 
exist T] = (jji, ■ ■ ■ , rjn)^, rji > i = 1, ■ ■ ■ ,n such that M^i] < 0. That is 

Cj — - ^ Cij ' Gj — - dij ' ^ij^jjVi 



p 



(41) 



which can be rewritten as 



1 1 



C.V^ + T.[-^~''''''G,V^ + -^rG,V, 



q p 
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+ 



1 



eijFjfji + -df^'^CijFjijj ) < 



P 



(42) 



By Lemma 1, we have 

-^^-''^^^^r], + ^<HfG,Vj > c^jG^viv! (43) 



Therefore, 

i_ j_ 1 i_ 

- CiTji + CijGjr]ir]J + ^ dijeijFjrji r]^ < i = 1, • • • , n 

]_ 

Thus, let — 7)1 , {i — 1, ■ ■ ■ ,n), we obtain 

By the property of M-matrices, there exist 9i s.t. 



-CiOi + GiY OjCji + FiY^ (^jdji^ji < 0, i = 1, • • • , n 
This completes the proof. 

Theorem 5 Suppose p > 1, q > I, ^ + ^ = 1 . Q > 0, > 0, > (i,j = 
1, • • • , n). If there exist 6*^ > (i = 1, • • • n) such that 

- Ci6i + GiY^ OjCji + Fi'Y^ (^jdji^ji < 0, i = 1, ■ ■ ■ , n (45) 
hold. Then, we can find constants > 0, a*^ , (3*^ such that following inequahties 

+ -Y.dt^^'^'ei^F^ii<Q, i = (46) 
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hold. 



Proof If there exist 9i > {i = 1, ■ ■ ■ n) such that fHSl) hold then, by the 
property of M-matrices, there exist Q s.t. 



Let rji = (f , i = 1, ■ ■ ■ , n, and 



P 



1 _ ]_ 

1 + ln|c,,| ' 



P 



1 + r//r/j. 



1 _ 1 

1 



(47) 



turn to be equalities. Therefore, we have 

P 



+ -A 



Q 



-Ci7]i + ^ CijGjTj^rj^ + ^ dijCijFjrj^rj^ 



1 1 



( - Ci6i + J2 (^ifijOj + XI (^ij'^ij^j^j ) ^ ^ = 1, 



which means M'^r] < 0. By M-matrices theory, there exist ^ = [^i, ■ ■ ■ , ^n]^ > 0, such 
that < 0. Thus, (H6|) hold. This completes the proof. 

Under that ^^1""^ + 1^1^'-""'^^ > Kl letting a = di - e - Gi\au\ - Fi\bul 
Cij = \aij\, dij = \bij\, Cij = e^'^'-', we have 

Theorem 6 Suppose that 1 < p < oo. If there are positive constants e, ^j, real 
constants Oij, jSij, i,j = 1,2- ■ ■,?t,, such that either one of the following two sets of 
inequalities holds 



[-di + e)e» + Gi 



in -in 

P j=i y j=i 



(4^ 
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-di + e)^i + Gi 



p 



in 1 " 



(49) 



Then there exist constants 6i such that 
{-di + e)e, + Gi 



Oi\aii\+Y, Oj \aji\ +FiY, Oj \bji\ e'^^' < 



(50) 



Theorem 7 Suppose that 1 < p < oo. If there are positive constants e, 6i 
i = 1,2 ■ ■ ■ ,n, such that 



-d, + e)ei + 



^ikiii + E^jl^il + FiY.^j\hM"'' < (51) 



Then we can find real constants a*^, positive constants C,i, i = 1,2 ■ ■ ■ ,n, such that 



[-di + e)^, + Gi 



1 



lap 



P 



1 



-in -in 

P j=i Q j=i 

hold. However, the following inequalities 



(52) 



-di + e)^i + Gi 



p 



in 1 " 

+ -F^ E + E F,K\e^^^^ < (53) 

P j=i 1 j=i 

are not true generally. 

Following example verify previous theorems 

Example 1 Let di = 2, d2 = 11, an = 1, ai2 = 3, 021 = 3, 022 = 1, hj = 0, Gi = 
G2 = Fi = F2 = 1. 



i) In case p = 1. The conditions ( |36l) in Corollary 2 are 



-(rfi-|6n|Fi)0i + 



aiiGiOi + ^2|'3'2i|Gi 



02\b2i\Fi 



14 



-{d2-\h22\F2)e2 + 



022^2^2 + ^l|a-12|G'2 



-Oi + 3^2 < 

ei\hi2\F2 



Wi - 10^2 < 



The solution to these two hnear inequahties is 3 < < 



01 ^ 10 



In case p = 2. Pick any 9i, 62 satisfying 3 < ^ < ^, for example, ^1 = 19, 62 = Q 



satisfy 3 < ^ < f . Let r/i = ^f, r/2 = 0^ and 



ai2 = - lnai2 (^ai2^i r?2 ) = 2 Y 
1 . / i -i\ 1 , 18 



^21 



In 



■121 



- In^ — 
2 19 



(54) 
(55) 



The inequalities in flMj) become 



-(di- |6n|Fi)ei + 



aiiG'iei + -|a2ir^^^Gi6 
P 



|(l-Ol2 



^'02^1 



+ - ai2 

q 

+-\b2if''^'F^^2 + -\bi2\^'-^''^''F2^i = ^^1 + < 
p g 19 19 



-(f^2- |622|i"2)e2 + 



022^26 + -|ai2|"^^^G'2ei 

P 



+ -|a2i|(i-"-)^Gi6 

+-\h2f^''F2^i + -\b2i\'~'~''^^'F,^2 = ^6 - ^6 < 

p q 4 4 



The solution is ^ < |^ < 7^. 

lu ^2 ly 

Although the parameters aij, (3ij and/or in do exist, it is very difficult to 
search for these parameters directly by solving the nonlinear inequalities (|34l) . There- 
fore, the criteria is of no great significance in practice. Instead, the parameters in (l36ll 
can be found easily by solving the hnear inequalities (|36|1 . 

Moreover, if we take 0:12 = 0:21 = P12 = P12 = |- The inequalities in fl35l) are 



-(rfi-|6n|i^i)6 + 



fliiGi^i + -|a2i|G'i^2 



+ 21^121^2^1 



+ ^|&2l|i^ie2 + ^|&12|i^2ei = + 1^2 <0 
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-(^2 - |&22|-f2)6 + 



^22^2^2 + 2 l'^12|<-^2'Cl 



-\a2l\Gi^2 



113 

+ -|&12|i^26 + 1^*21 1 = 



17 



-6<o 



In this case, there is no solution. It means that this criterion is less effective. 



6 Conclusions 



In this paper, we address criteria of global exponential stability for delayed periodic 
dynamical systems in terms of various I^(l<p<oo) norms. A general approach 
to investigate global exponential stability in terms oi LP {1 < p < oo) norms and 
sufficient conditions are given. Comparisons of various stability criteria are given. 

More importantly, it is pointed out that sufficient conditions in terms of norm are 
enough in practice. The criteria in terms oi LP (1 < p < oo) norms are of no great 
significance. 
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